Asymptotic Expansion and Error Exponent of Two-Phase Variable-Length Coding with Feedback for Discrete Memoryless Channels

نویسندگان

  • Tsung-Yi Chen
  • Adam R. Williamson
  • Richard D. Wesel
چکیده

This paper studies variable-length coding with noiseless feedback for discrete memoryless channels. Yamamoto and Itoh’s two-phase scheme achieves the optimal error-exponent, but due to the block-coding nature it is not optimal in the expansion of the message size logM . Polyanskiy et al. showed that with feedback, the back-off from capacity is logarithmic in the expected latency l. The O(log l) back-off is achieved by using an incremental redundancy (IR) scheme that only utilizes feedback to determine the stopping time. However, the achievable error-exponent of the IR scheme is not optimal. This paper shows that a two-phase coding scheme where each phase uses an IR scheme achieves the optimal error-exponent while maintaining an expansion on the message size that yields the O(log l) back-off.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

The Reliability Function of Lossy Source-Channel Coding of Variable-Length Codes with Feedback

We consider transmission of discrete memoryless sources (DMSes) across discrete memoryless channels (DMCs) using variable-length lossy source-channel codes with feedback. The reliability function (optimum error exponent) is shown to be equal to max{0, B(1−R(D)/C)}, where R(D) is the rate-distortion function of the source, B is the maximum relative entropy between output distributions of the DMC...

متن کامل

Extrinsic Jensen-Shannon Divergence: Applications to Variable-Length Coding

Abstract—This paper considers the problem of variable-length coding over a discrete memoryless channel (DMC) with noiseless feedback. The paper provides a stochastic control view of the problem whose solution is analyzed via a newly proposed symmetrized divergence, termed extrinsic Jensen–Shannon (EJS) divergence. It is shown that strictly positive lower bounds on EJS divergence provide non-asy...

متن کامل

On the Reliability Function of the Common-Message Broadcast Channel with Variable-Length Feedback

We derive upper and lower bounds on the reliability function for the common-message discrete memoryless broadcast channel with variable-length feedback. We show that the bounds are tight when the broadcast channel is stochastically degraded. For the achievability part, we adapt Yamamoto and Itoh’s coding scheme by controlling the expectation of the maximum of a set of stopping times. For the co...

متن کامل

Moderate Deviation Asymptotics for Variable-Length Codes with Feedback

We consider data transmission across discrete memoryless channels (DMCs) using variable-length codes with feedback. We consider the family of such codes whose rates are ρN below the channel capacity C, where ρN is a positive sequence that tends to zero slower than the reciprocal of the square root of the expectation of the (random) blocklength N . This is known as the moderate deviations regime...

متن کامل

On The Reliability Function of Discrete Memoryless Multiple-Access Channel with Feedback

We derive a lower and upper bound on the reliability function of discrete memoryless multiple-access channel (MAC) with noiseless feedback and variable-length codes (VLCs). The bounds are similar to the one for point-to-point channels, increasing linearly with respect to an appropriate distance between the rate pair and the capacity boundary. For the lower bound on the error exponent, we adapt ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2014